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© Spatial bandwidth testing for digital data-compressed video system. 



(57) Spatial bandwidth testing for digital 
data-compressed video systems is performed 
using a complex, or high entropy, test signal. A 
portion of the test signal is acquired as a control 
frame. This control frame is divided into a 
plurality of blocks. Each block is processed by a 
two-dimensional Discrete Fourier Transform 
(DFT). The test signal is input to a digital 
data-compressed video system (10) and a corre- 
sponding portion of the output of the video 
system, a test frame, is acquired (20) and pro- 
cessed (22) in the same manner as the control 
frame. The resulting coefficient arrays from the 
control and test frames are compared (28) to 
each other to obtain an output array of ratios for 
each block. The ratio of those coefficients cor- 
responding to the predominant frequency of 
each block of the control frame are displayed 
(30) as a three-dimensional gain plot The ratio 
of those coefficients corresponding to low fre- 
quencies of each block of the control frame are 
displayed as a three-dimensional noise plot 
The resulting plots provide an objective, visual 
indication of the characteristics of the digital 
data-compressed video system. 
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Background of the Invention 

The present invention relates to the testing of data- com pressed video systems, and more particularly to 
spatial bandwidth testing for digital data-compressed video systems for analyzing distortion of transmitted vid- 
5 eo images resulting from the data compression. 

Data-compressed video systems, such as video coders/decoders (codecs), use data compression techni- 
ques in the transmission of video images to meet the bandwidth limitations of the transmission medium. Analog 
systems suffer from well understood phenomena, such as gain error, high frequency roll-off. group delay error 
and non-linear effects. These distortions are a function neither of the signal being transmitted nor of the signals 
10 previously transmitted, and they are amenable to analysis with traditional test equipment Digital data- 
compressed video systems, however, produce distortions that are a function both of the signal being trans- 
mitted and of signals previously transmitted. The distortions are a function of the spatial and temporal com- 
plexity of the transmitted image. Images with higher entropy, i.e., randomness or lack of predictability, generally 
suffer more distortion. Traditional test signals suffer little distortion since they have low entropy - such signals 
15 are highly correlated along at least one axis. 

Test methods are needed that use high entropy signals. Unfortunately the very complexity of such signals 
makes them difficult to analyze numerically. Therefore most testing of digital data-compressed video systems 
has involved subjective testing of complex picture material by a group of trained observers. This testing is ex- 
pensive, complex to set up and, as it requires a highly controlled environment and the presence of the trained 
20 team, is not easily reproduced at any arbitrary location. 

Another recent attempt for testing digital data-compressed video systems is disclosed in U.S. Patent Ap- 
plication No. 07/663,220 filed March 1, 1991 by Michael S. Overton et al entitled Three-Dimensional Testing 
of Video Codecs." The test signal used is a conventional test signal over a complex background signal, such 
as a pseudo-random noise signal or a zoneplate signal. A conventional measurement system, such as a wa- 
25 veform monitor or oscilloscope, displays the conventional test signal, with distortions caused by the complex 
background signal appearing in the display. The measurement instrument may be a spectrum analyzer where 
the background signal is a zoneplate signal. 

What is desired is spatial bandwidth testing for digital data-compressed video systems that uses a high 
entropy test signal to provide an objective characterization of system distortions. 

30 

Summary of the Invention 

Accordingly the present invention provides spatial bandwidth testing for digital data-compressed video sys- 
tems using a complex test signal that varies spatially and temporally. The complex test signal is applied to a 

35 digital data-compressed video system, and a portion of the output of the system is captured. The captured video 
portion is subdivided into small blocks of pixels and a two-dimensional Discrete Fourier Transform (DFT) is 
applied to each block. The resulting array of coefficients, representing the phase and magnitude of each spatial 
frequency in the block, is compared to a coefficient array for a corresponding captured portion of the complex 
test signal at the input of the system. The resulting comparison is displayed in an appropriate format to indicate 

40 both the gain and noise response of the digital data-compressed video system. 

The objects, advantages and other novel features of the present invention are apparent from the following 
detailed description when read in conjunction with the appended claims and attached drawing. 

Brief Description of the Drawing 

45 

Fig. 1 is a block diagram of a system for spatial bandwidth testing of a digital data-compressed video system 
according to the present invention. 

Fig. 2 is a display of a test signal that is used for spatial testing of a digital data-compressed video system 
according to the present invention, 
so Fig. 3 is a pictorial representation of a simple coefficient array according to the present invention. 

Figs. 4-9 are plots of the test results for a pair video codecs indicating both gain and noise characteristics 
according to the present invention. 

Description of the Preferred Embodiment 

55 

Referring now to Fig. 1 a digital data-compressed video system 10, such as a video coder/decoder (codec), 
to be tested receives a complex, or high entropy, test signal from a test signal generator 12. Both the complex 
test signal from the test signal generator 12 and the output from the codec 10 are applied to a test instrument 
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14 for analysis of the gain and noise characteristics of the video system. A test signal that may be used is a 
variant of a zoneplate bull's-eye, as shown in Fig. 2. where the lowestspatial frequencies, normally in the center 
of a video ,mage, are located in the upper left-hand corner of the video image. This test signal contains a ranqe 
of horizontal spatial frequencies, increasing from left to right, and vertical spatial frequencies, increasing from 
top to bottom. There is little redundancy in this image, i.e., there are no two regions within the image in which 
the combination of horizontal and vertical frequencies is the same. Because some data-compressed video sys- 
tems transmit high entropy images by gradually increasing the resolution of the image over several frames for 
static images, a temporal component is added to the signal. Thus the zoneplate signal is a sinusoidal output 
according to the equation: K 

phase = 2 • pi » (k + k x . x + k xs * x2 + k„ . x * t + . x . y + k y . y + kys . y* + kyt ♦ y . t + 

k t .t + k ts *P) 

where x is the horizontal location, y is the vertical location, and t is the temporal location of the image pixel 
to., t is the time within a sequence of images from a start of the sequence at t=0. The temporal component 
has the effect of continuously moving the lines within the image, with the speed being adjusted to challenge 
systems that estimate block motion. Also to test for video systems that might handle diagonal information with 
one tilt drfferently from diagonal information with the opposing tilt, the zoneplate test signal may be modified 
by adjusting the Ky and Ky* coefficients so that the [0.0] frequency occurs at the center of the left-hand side 
of the video image. 

With this test signal applied to the video system 10. a portion of the video output from the system is cap- 
hired by an acquisition system 20 of the test instrument 14. The captured video portion is subdivided into small 
blocks of p.xeis, such as 32 pixels wide by 16 pixels high. Each block is input to a two-dimensional Discrete 
5T I ranSf0rm (DFT) circuit 22 The DFT circuit22 calculates a real-valued DFT for each row of pixels within 
the block to produce an array of sixteen rows each containing sixteen complex coefficients representing the 
amplitude and phase of the horizontal frequencies in the block. Next a complex-valued DFT is calculated for 
each column of complex coefficients in the block. This also results in an array of sixteen rows with sixteen 
complex coefficients representing the amplitude and phase of the two-dimensional spatial frequencies in the 
block. The resulting test array of coefficients is stored in a test memory 24. 

The above calculations are repeated for a corresponding control video portion of the complex test signal 
at the input of the video system 10 to produce a reference array of coefficients. The reference array of coef- 
ficients is stored in a reference memory 26. Each block of the reference array has peak coefficient values for 
a small number of spatial frequencies, with other frequencies having very low values. For example a block at 
the upper left-hand corner of the image of Fig. 2 has a high coefficient for the frequencies near [0,0], shorthand 
notation for horizontal frequency = 0 and vertical frequency = 0. A block at the lower right-hand corner has a 
high value for frequencies near [20.20], where spatial frequencies are expressed in cycles per active picture 
height (aph). A horizontal spatial frequency of 20 cycles/aph corresponds to 20.(4/3). or 26.7 cycles per active 
picture width for an image having a 4:3 aspect ratio, such as NTSC. 

Although Fig. 1 shows the acquisition circuit 20 and DFT circuit 22 being switched between the two inputs 
and between the two memories 24, 26, two acquisition circuits and DFT circuits may be used so that the ref- 
erence and test arrays are obtained in parallel rather than one after the other. Also the memories 24, 26 may 
40 be different areas of a single memory device. 

To determine the spatial bandwidth of the digital data-compressed video system 10, the test arrays are 
input to a comparator 28 together with the corresponding reference arrays. The ratio between the values of 
he coefficients in the test array and the reference array is calculated for each block for those frequencies 
that predominate in that block in the reference array. For example the predominant frequencies in a given block 
may be defined as those having coefficients exceeding 75% of the amplitude of the largest coefficient in the 
involved" 31 data " compressed video s y stem without distortion has a ratio of 1.0 for each frequency 

To determine the noise contribution of the video system 10. the differences between the values of the 
coeff icients for the test array and the reference array are calculated for each block for those frequencies that 
have near zero coefficients in that block of the control frame. For example the noise frequencies in a given 
block may be those having coefficients less than 5% of the amplitude of the largest coefficient in the block 
The ratio between this difference and the value of the largest coefficient in the block is calculated. An ideal 
digital data-compressed video system without noise has a ratio of 0.0 for each frequency involved. A display 
system 30 performs the processing of the ratio information from the comparator 28. 

A simple flowchart for the calculation of coefficients and the corresponding ratios may be as follows- 
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aax_coef f icient_value *» 0*0 

for each row r in the block of control coefficients 
{ 

for each column c in the row { 
if control_value[r] [c] > 
max_coeff icient_value ( 

max_coef f icient_yalue - 
control_y alue [ r ] [ c ] ; 

> 

} 

} 

for each row r in the block of test coefficients { 
for each column c in the row { 
i f cont r o l_y alue [ r ] [ c ] > 
(0 • 75*max_coef f icient_yalue { 

gain[r][c] =» abs (test_value[r] [c]/ 
control_value[r] [c] ) 

} 

if control_yalue[r] [c] < 

(0 . 05*max_coef f icient_value) { 

noise[r][c] ■ (abs (test_value[r] [c] - 
control_value [r] [ o ] ) / 
max_coefficient_value) 

} 

> 

} 

After gain[r][c] and noise[r][c] values are collected for each block of pixels, the final value for Gain[r][c] is cal- 
culated as the mean and standard deviation of the collection of gain[r][c] values, and the final value for 
Noise[r][c] is calculated as the maximum of the noise[r][c] values. 

The spatial bandwidth and noise values determined above may then plotted by the display system 30 as 
three-dimensional bar charts, as shown in Figs. 4-9. The coefficient for frequency [0,0] appears in the back 
row at the left-hand side of the display. This corresponds to the average DC level of each block tested. The 
coefficient for the highest horizontal frequency with no vertical frequency component, i.e., closely spaced vert- 
ical bars, appears in the back row at the right-hand side. The coefficient for the highest vertical frequency with 
no horizontal component, i.e., closely spaced horizontal bars, appears in the front row at the left-hand side, 
and that for the highest combined frequency, i.e., closely spaced diagonal bars, appears at the front row at 
the right-hand side. As an example, referring to Fig. 3 for a three by three matrix, the bars would correspond 
to the amplitude of the spatial frequencies shown. In the 3-D plots of Figs. 4-9 the height of the bar is directly 
related to the value of the coefficient. In the frequency response plot a reference "1.0" bar is shown to the 
right of the plot corresponding to the largest amplitude coefficient for the reference array block. Ideally the 
frequency response plot would show all bars at the same height as the reference bar. In the noise amplitude 
plots a reference "0.1" bar is shown to the right of the plot, and ideally all bars would have zero amplitude. 

The plots of Figs. 4-9 represent the responses of a pair of different video codecs, referenced by letters A 
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and C Forsequenceswhere there is temporal movement of the testsignal, the video codec output frame havinq 

st t^Z P 5£ *l COntr °' fra '" e iS S ° U,Ce ° f thS Vid6 ° P ° rti0n a ^ u ' red for Processing. The brackets 
at the tops of the frequency response bars represent standard deviation of the coefficients. Also dotted lines 
appear m place of bars at some places in the plot, representing spatial frequencies with amplitudes less than 
loioin "TT amP ' itUde in b ' OCk ° f * he C ° ntro ' •""■»■ Fias - 4 and 5 ' m ^ked AO-OOOO.gai and 

^S^ndes frequencies, and relatively high noise contribution from a number of diag- 

Figs. 7 and 8, marked CO-OOOO.gal and CO-OOOO.noi, represent a second video codea The frequency re- 
E!2E?T" a / a n r ' y "? :i SP ° nSe Wlth thS 93in rati ° eXCeeding °- 5 at a " ,oca «ons. The noise plot shows 

™:i sisar uencies other than [o>01 to be be,ow s% - The ,ar9er bar - ™ 

c:^? 6 H Umeral a I terth u e Vid6 ° °° deC identifvin 9 letter . n-nr,nn. indicates a pattern using Kt = n.nnnn c/aph. 

nZf,? ' *«T™ 3 ! Sh ° Wn i0 FiQ - 9> Sh ° W Very ' itUe Change in freauenc V response or noise with tem- 
poral frequency Kt Th.s codec probabty does no inter-frame coding. Some, such as that shown in Fig. 6, show 
degradat,ons ata particular temporal frequency. This effect may be related to the algorithm used for inter-frame 

hJSJZZZ 1 ™ Fi9 !' SPa ! al bandwidth testing for video codecs according to the present invention dif- 

JZ^SrSr °I T 38 ShaP6S ° f thS SPatia ' freqUenCy reSDOnse and "° ise P |ots d i«er greatly be- 
Other h.gh entropy test patterns than the zoneplate pattern, such as radial patterns etc.. may 
be used so long as the pattern includes all combinations of horizontal and vertical spatial frequencies 

Thus the present invention provides spatial bandwidth testing for digital data-compressed video systems 
b Jth a T nn9 3 T ° f Vid6 ° ° UtPUt ^ the Vide ° System in res P° nse to a ni °* entropy test signal 
7Zl^ e *TT 9 COntr °' V,de ° POrti ° n d6riVed direCt,y fr ° m the high entrop y test and y presenting 

IcLXJ h h 7 a r/ epreSentm9 9a,n and noise responses as a function of frequency to objectively char- 
actenze the digital data-compressed video system being tested. 



Claims 

1 " stepl of d ° f SPatia ' bandWidth teSti " 9 f0f 3 di9ital d ata-compressed video system (10) comprising the 

generating (12) a complex test signal having a range of frequencies in each of the horizontal, vert- 
ical and temporal dimensions; 

applying the complex test signal to the input of the video system; 

rt r ♦„ aC ? U ' ri " 9 (20 > a portion of the com P ,ex te st signal as a control frame and a corresponding portion 
of the output from the video system as a test frame; 

dividing the control and test frames into corresponding blocks of pixel data- 

r i.- J? ^I?" 9 .^ } a " 3rray ° f SpeCtral M icients for eacn block to P roduce a reference array of coef- 
ficients for blocks from the control frame and a test array of coefficients for blocks from the test frame- 

coefficSTnd 9 referenCe 8rray and the test arra y to obtain a ratio between the corresponding 

plotting (30) the ratios to provide a visual display of characteristics of the video system. 

A method as recited in claim 1 wherein the complex test signal comprises a modified zoneplate signal 
tionT 9 3 ra " 9e frequencies from a minimum to a maximum value in both horizontal and vertical direc- 

A method as recited in claim 2 wherein the minimum frequency value in both horizontal and vertical di- 
rections occurs at the upper left-hand comer of a video display of the modified zoneplate signal. 

4. A method as recited in claim 2 wherein the minimum frequency value in both horizontal and vertical di- 
rects occurs at the middle of the left-hand side of a video display of the modified zoneplate signal. 

55 5 " l met f h ,°K d 33 ; ecited in daim 1 wherein the portion of the complex test signal and the corresponding por- 
tion of the video system output comprise one frame of video data. 

6. A method as recited in claim 1 wherein the obtaining step comprises the step of determining the maximum 
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coeff icient for each block of the control array. 

A method as recited in claim 6 wherein the comparing step comprises the step of determining a gain char- 
acteristic for the video system as a function of the ratio of the corresponding test coeff icients to the coef- 
ficients of the control array that exceed a given percentage of the value of the maximum coefficients for 
each block. 

A method as recited in claim 6 wherein the comparing step comprises the step of determining a noise 
characteristic for the video system as a function of the ratio of the difference between the corresponding 
test coefficients and the control coefficients less than a given percentage of the value of the maximum 
coefficients for each block to the maximum coefficient for each block. 

A method as recited in claim 8 wherein the comparing step further comprises the step of determining a 
gain characteristic for the video system as a function of the ratio of the corresponding test coefficients 
to the coefficients of the control array that exceed a given percentage of the value of the maximum coef- 
ficients for each block. 
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